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* -^-aOo;U \ ^vimu^ 

Bo c k g r oaed _ o i t he I say a a. i i on 

S - > Affi! k. s s; ransmusssion electron 

microscope which inoloo.es? the apparatus? and which, con 
parfor® the method.. The indention has particular 
application to the production of phase images; of an object 
o bp t s as a»i sa xos 

' ^ ss I eras, cap-; • 

E :f oLt^JEO^ H£gS**i£S 

It £a known that a phasa .image of ass o&isct cmx be 
generated by oasantitative detessdnatio& of *&* of 
15 on vsavatx^ & * vs fra the object s n 

International Patent Application he-., S»C!t?/aX?SS/0D94£ 
(Publication Ho, PO .> owed bp The University of 

lac phase 

images is discloses! which involves solving th« transport 
2 0 of intensity eguacien to m'sablss Path phoaa and intensity 
x s s s ct t< co d 

i^depeadamtly * This enables a phase \ x\\ ■ x 
he pro&xsatl which can provide detail.,, particularly in 
cot appa 

2 5 c nvsntional ntensita da-so fci % haaga < ho 

la viewed .x The contents of the above -area tionad 
International specification era incorporated into this 
oi et ance 

3 0 ^ x s sn \ »\ s 

with generating images in the visible part Of the 
m &Xthowh the s os d in the 

•application io also ssafnl for producing ismm® from other 
arts of the elects magnet 
35 and also faces particles exhibiting wavelika phenomsna 
including electrons,- neutrons axsd atoms. 



Is i asrticxj arly o ?a »m« - ; the 
by ir read m ob;h i 

phase images prodecad by a 



The invention, a first aspect, sawy fee s«i& to r^sid^ in 
^ps-ratma for - producing a pfaut«. .itefte of an object, 
ion lading; 

neans for producing a hastm of « 
support ss#ats^ for supper*: i. as s >jact; 
at least o»« maga&ts&o X«os tar receiving ar* 
ol«ctrio signal and produoissg a aagaa&ie «i»Xs3 for 
socaaiof the «£*Kftron beam e?&aasting fro® the object; 

control meane £or coat rolling tha slsctnc signal 
t a.Ued to the magnetic lenn so ass to adiast the position 

* h las gresc x v I aua ao 

tkt an in focas \ v? and/or defocased images of the 
ofejeat ana prodncad at the planer and 

t -n^ t >. aa^os to 
enable a phase- image of fch* object to b® generated, 

N - x N • his a^psscfc of t&a invention the images? 

taagairad i; ier to generate the ehese image a.; < S 

by ting tto magnetic ions ao 1 an? ^> s 

is? etis strength to thers pro ce - 

feces cad/or defect***! images at the plane, which provide 
the data from which the phase .lavage can be genera tec. 

Preferably the at least on® Xeaa i» en objective kw, 

Preferably the nagnetia lenses or magnetic leas are formed 
from natal, grids or places to which a voltage is applied 
to generata a magaetic field which Soenaea the electron 



areferably the n s * comprises? a charga coupled decdes 



at the plans f:or denting eh* *i^;&rcr. b^ae and ^r^idxf (S 
a data output indicatiae of -be isaegee detected by the 
charge eoupled 

Prat erably aba charge coupled <S*vi«* ±& to 

aaa for race 5 1 data and £< p ;S c® is ? 
tba data to to a phass image* 

v s a a ab \ x t&t ^ In 

accordance with the algorithm di«clo*«a in the «bow» 
identified international patent applicat ! »» to t * Acs the 
phaae imaga. 

The control sseana may ««««jris® a manual control for 
adjusting the voltage allied to t&* »psti<? lata. 

Heweer... in the preferred e\abodis8ont of the inaention the 

- i t x a-sds ® $> and tha 

processing neanss,. upon aser iapufc, causes the voitaga 
aappXied. to the lana to be adjusted so as to produce in 

images >£ the o.bj v v t< the 
data faas; which tea phase imago can ba generated* 

Preferably the ps x also oapssaaatas ; 5 eherx \ an; 

xnt sodacaa by the magnet i« l<m* hy performing a 
transformation an the dat& $m&6*& by tba detsotor 
relating to each of tba imagee, 

- - ^ ^ <e a i aa tax* * son v> u^a^ned by 

< bt sdnis g a eta re ting t 

producing a trasxafornation reo-aired to convert the 
detected data relating to tba kne-sm reference aaaple to 
aonfo ait th ee * \ raferesw < * 

to eomnart tba data to thereby compeneate for abatratione 
intxoabaced by tha aagnetie leas, 
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In aseih-r ^wCodlasrt of ^ invention th* 
is t bta.i»«a be supers > \ x * in 

fccu® image., aad the dsfscissad Image iss Krarfomsd so as 
to align data in * lo def censed iamge with corresponding 
data in the in £®et*a Sas&g*. 

Preferably the transformation co^risBs a coarse 
transformation, in which thm tt»fcn> -onl tha in 

a; imaga are oaerls ■ one of aha Is t ge; s ; nov»d 

relative to the other imago to data in thm imrngm, 

and then a fins alignment stsp in which th® defooosed 
i»»g# £» Into cell® and each cell is compared with 

a corresponding call of ttsa in focus laa&s**- 80 as to sso^a 
data in each coll to »or» finely align that data with the 
data in corresponding ceilis of thtt in focus imago » 

'too , ^ the 

, rhe 

overlapping regions of the deioeasad and in focus images, 
aad wherein th > e io-- Uvksiog the 

cropped defooasad. Imaga® into - plurality of cells, 

tradable he plural 'tv cl calls o£ tha \^ ocu^«i liaag® 
are- .moved relative to too in focus calls in a racier 
pattern, and correlation values for each mo'vamant in tha 
pattern aro obtained to wra&X* t&a hmst. correlation,, and 
therefore tha location of the in focus call relative to 
tha daf ceased call which provides the beat correlation. 

Ih:sf.srably the corralatios vales far each call is avsrsgod 
with neighhooring calls so as to produce an average 
c err a lat 1 an f eat or , 

Preferably the cells are warped in accordance with the 
correlation factors in order to nova information within 
the calls so as to provide fine correlation of that 
- s - v. s >• s - s - iwtiv^ ^ in 



beef or ably the aanaratns is inchnsea in a transmission 



for a> s\„m rhe 



laamst one eon&anaer lens for reaaalving an 
electron b©a» from £h® &n<S)2» *n&- £&tsnmlm thm «l«ctron 
beam ^ . x 
object; 

the objective l«m® for - » x n, ^loctros« 
trswum£tt®<t through the objwt for ■£<##t»&a& *h» 
electron .beam into an imagag and 

an istermsaiaaa ^n and % projector lens for 
x a t 5m - * ^a v x o ^ ^ N sector, 

N ^ N - on. - N v>* also ;Jb*>- s&id to wsMe in & m»the4 of 
v N * s - - a iM&a* Of an obj&ot; from an electron 

causing am elect; - w:; 

suv& deteetimg th« «l««.fcron beass eaemmting from baa objcota 

focusing tbo ol x o beam emanating from the 
object with a magnetic boss lacs by adjusting an el#ctrl« 
ro.anri ^called to the lens so as to produce an in focus 
asa/c;.- bcibaanaai ist&gss of the object | 

aroeaasing data relating to the in tooxis and/or 
aasaeasea imagos of the object so as to generate a phase 
Imago of the objecb.. 

Frafcr^ab/ she at least aea sag-eta: lamas ia an objaobiTO 

Preferably tbo magnetic lens ia formed tram natal coils, 
gride or plates be which a voltage is as>f»I£»4 to generate 
a magnetic field whieh £qoiuh*i the electron beam* 



WO 12822 



ti s uos-s 



J?r®£*rably the dateotor s^sprissa a eb&rgs coupled device 
for d«t««ti&s tkm electron bsaa and providing a data 
©H*p«fc iMic&fciw of tbo ismg®® dsfaoted by tim charge 



Ifrwtw* tha v step processes; data in 

&ccgt$W*S* Vifcb. the algorifcloi di*.el6»«d in the above- 

patent application to »u x * th« 



The v x 

conu.sX for adjusting the applied to th* w«<jn«&ic 

Ho^m, in toe preferred «asfeo<Hs8*»fc. of the imonstion the 
eootrol ie ^\ aodar to* influence of o procaesins 

the so iod to the I ns to fee 

^ a* o cuesd shaagsa* as' ^ he otjoo?; to 

provide the data from which tha phase iaaagss can fess 



■ also coops aretes f 
is-Jodsrvd sy the oogossle Sens 'by performing a 
trarsUh>rrsatisn on tho data provided by the detector 
reiatiog to each of tt 



N - * O N ^ t i. 

x x N N -a ' <s \ v a 

trans forsmtioo rsguirsd to cowssrt the detected data 

soosa afore o napls 5 < s « s h 
kao-ao reference saacds f applying thso;. tr&osf o:coasios to 
tha d\*^ p^oao e\ V\ v ^ to v t 
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data to th*r*by Cor aberrations introduced by 

the magpie I fens. 

In another si^oskMt of tb® iw^tios the transformation 
S is obtains*! by sosspatiug the a®£ocusa<| inage with the in. 
focus - < - nags L trans* need o as 

to align data in the defected iaaga with ;: or responding 
data in the in *oeu» imas?®» 

10 Preferably the trassfomtion <ccmg>ris«s a coifse 
nation in which the dsfosnsed: naga and hi 
focus Inage are overlapped and one of the ia*g«« is? kvssI 
rsXati** to the other image to align data in rle, i*»*g<»j?, 
and theo a fine alignment step in which the def sensed 

15 iiM§a is divided into ceils and each cell is carpeted with 
a corr*aiK>»aii*g- call of th® in focus image, so as to mow 
data in each coil, to turn.- finely aXiga that data with the 
da; > , -\i se eeiXa of the in tocos inagao 

SO rhe ess in 
inagee so as i % onsisi 

owrlappi og regions of tbo defoeased. and 
n v , t on iac b 

N " ^ plnra3 

25 

Preferably the plurality of «#XXs of the deioeassd 
are wwac relet loss to the la £o<ms calls in a raster 
pattern, and correlation raluos for each nooemeat in the 
pattern ere obtained to enable the best correlation., and 

tee def reused sell which provnhes the basst correlation, 

g.rstorahly too correlation value for each cell is aosraged 
with neighbouring cells so ae to produce an average 
35 sos ; slat U n fact ox . 




■ • • oably the cells are warped in accordance with the 



ivs 



* ( - 

correlation factors la order to information within 

the calls so as to preside t \ correlation of that 
information with tho corresponding information in the in 
focus issage* 

Too •>. I« u 

Phase von, t ,s -ikl^ot: \uoxos hi Kccu* sou " t \ x no . 
i*»9*8 prndneed by a beam of electrons which transmit; 
throngh or are reflected fxtm an object, and in which the 
beam of electrons is controlled to produce in focus and 
defocnsad images of tha object, said apparatus inclsdhsgs 
procsuu ns fori 

|a) rescuing distortions ires; the dafoosnsed 

images introduced into the he focused images 
whan the deiocased images? are ohtoiood ta 
tho control of tin ss< at - lasasi and 

(b) pr&e*»9i.n9- i» focus and de focused 
images to prodnce a phase is»g« of aha 
object. 

Preferably the phase :i:H-;u) lis oaedaeed foon the la faces 



Is souther embodiment of ens invention the trcxonlonwatioa 
i» obtained &y ee»sriss the M&tmw9& 4m#® with tha in 
gooua image* and the deiocoe-d iaage ie 
to sl.ipu data it the detoeosso: image with 



Preierahly the truest const ion eos;priees a coarse 
transformation in which the da focused imaga and tha in 
focus image ire soerlapi > 

relacina to the other iasag* to align data in tha images, 
and thee a fine ahhjanent etep in which the deiocused 
imago i.s divided .Into coils and each cell is coopered soth 
a corresponding call of the in icons image, so as to mono 
data is each call to more finely align that data with tha 
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- spend el s of tl» J v s 

Tha wars® aXignnent step may further L^:«:h=- crapping the 

®e ea to pwids an issage coneiating of the 
overlapping regions of tho defooneed and in focave ioapee, 
and therein the fine alignment step ioeXudea dividing the 
cropped defo^aw* images? into the glur&lity of. cells. 

J»*»£»rabXy the plurality oi cells ot the 
«» moeed relative to the in £e«»s cello to a raster 
patte s 1 <. - s n iss the 

pattam ere obtained ro enabXe the best correlation, roe 
therefore the location of the in focas cell relative to 
? ■ - d eaaed cell which provider the hear onvis xc- to 
foa obtained. 

graferaXsly the correlation y&lme for each call is averaged 
-with neighbouring cells so *e to produce as average 
cos . s factor* 

Preferably the ceil* are warped in accordance with the 

the ceXia so as to provide fine correlation of that 
* nu-o.net ion with the co*\ n « t* o - ~hv ^ 

tom« image. 

In or: « ajabod react the trans format ioa is obtained by 
obtaining data relating to a bnown reference 
producing a t*«isi ; n regnirsd to convert the 
detected hue relating to t he fcnow a sample to 

conforn v.d.;:b the known reference sample, apglyirg that 
irana formation to the data produced by the detector a ae 
to § eta to thereby conspaneata for aberrations 

introdaced by the nagnetie Xeoat. 

The invention alee provides ass apparatus for producing a 
sot o - ine s a i yce 



iamgea product by a beam o£ skctrons which tsansHtlt 
through or aro *e£X®cfca<S from as object, and in which tU® 
hmm of eXactroa is? control I «d to fr ro«uc* ^ Idcus and 
3tfo«w^ oi the object, saia apparatus incUKHag; 

5 procec • ->s for; 

(a) rawing aisfcorti©*!* from the deforosad 

i^gea introduced info the defooaaad images 

<Kfe»- *tefoe«**$ .'iMgH ar« obtained by 
the control of th«- m&g&ebie ions; and 
10 {h} processing tim in focus and Mocus** 

iss&0®« bo produce a phaas image of bb# , 
object, 

N ' y tb« phaae imago ia produced from the in iocaa 
IS temm and fcwm defoeuaod Jang** of *&* obi sot. 

Bria;£ PsiScri.pt loo of tba S:t"awis<p 

A x \ vi of the indention will 5 bad 

by o* onaasple , with reference to the accompanying 

£i$»r* 1 ia a vi«w of an apparatus embodying tba 

rigur* 2 la a view of a rsfarsmea grid uaed in 
thm preferr«a <wrib«tiU»*»$ of the i*wa»ti«»* 
25 Figure 3 is a view of a reference grid e® 

detoctad by th» w«r«ttt» of Figure 1? 

Figaro 4 is a vi«w of an actual aample as 
M--^ by tbe apparatus,* 

Figure 5 is a v.Uw of »n actual sample with 
3 0 abas rat i ona od 1 

of the invention.? 

Figures 8, 1 and a arm £ low charts iilu; s s a 
farther embodiment;.? and 

Figures S, 18, 11, 12, 13 and 14 are diagrams to 
3 5 uaaist understanding of the flow charts of Figures € to 

::v^ £ : L y :£j ,:n^o:: ,i :5.;5::i.:t:i^ ■ ■ ■ 




but only as« isus in 



A t»pl* s is located a * supp *t in ha baas* 14 
*®*a*t«* th® e€m&s»s«r lens it so fclafc th© beam of 

aieetroos is able to pisstrat® tha «ass?pl# S« Ths beam 
emanating fs« the swpie S is focussd tost a» o&jsctilw 
leass 22 which isay iatfludft s. pfay*is.al ap@rtu.ce to rw^lct 
the electron, beass passing' through 'tb» c^«ct'±*» l<m* 22. 

to i»fc«o$»diat» l«as 24 and a projector 26' &r« provided 
b-n un:t;wr co^itisming of tb<a «l*»fcro» boao ami for 



The i b. ^r,t *cr*«m aa «n&bl*s an ixsage of the - «,i a 

to be bsarw 

The ap { : -Lodes a pro;e^sbac asotion 4\ N vh, is 

a k ed to cha ebasgw c©upl«d $mri.<3» 27 tor receiving 
data relation to the imags asd for displaying the im&g* on 
the TOitor 30 it re^irad* >Sh* charge coupled device 27 
oao be -roved out of the field of view of the fluoresce 
screen 28 to anahla the scr««» ?8 * ^ ^ imago 

The prooessiog section. 40 also includes a control section 
44 which is eonsected to K-he objective lens 22 tor 
supplying voltages to the objective lens so as to control 
the objective lees 22. The control section 44 may also tee 

IS, 24 and 26 and 



l>CT/Al.;02/{f1{?t'> 
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also the *m«ste i« for supply of appropriate control 

toitmm bo that tfe bf» u , a md o >*ition** 
for Imaging onto the device 28. 

S in general, a aasr is able to control the condenser loos 
18 by adjueti & co ro2 k»ob * 

of the eoadtture* l*na IB dstursdnes the *&pot «±ss*» of tim 
*l*e%rm b»»n tmpimi*® on the sample s» Xf the condenser 
includes a second X«ms, the second loos cas also bo 
10 control led by a us#r actuated knofc wki«t* controls the 

i&t«x»ity or hrlghtnm® fey changing fch« sise of thm spot 
on the sanple from a dispersed Spot to a pinpoint 

beam. 

15 In order to produsso a phase issage of the object ass 
disjunct from a mm®nti®m% ^electron intangity or 

?** whien would normally fee whet is absorbs! 
on the device a?> a* least two iss&ges (preferably tte&e 
images) of the sample S aw required v The images emprise 

20 either an in focus image and oss defoouood image of the 
s aspie ox > Tia n 

focus and &e focused iaurgss are obtained by adjusting the 
coot red voitaoo supplied fey the control unit 44 to one 
ohjactise fens 22. So «* to olumge the magnetic Siald 

3S generated by tlm Ions 2a to, in turn, change too focus 

produced by that lens so that the isaage is focused on th& 
■ewwo 28 to produce en in focus issage or, alternatively * 
images are focused on aithor side of the plana of the 
deriee 2? to gradaoo defocused images of the sample S. 

30 

In order to produce the in focus and/or defoensed images 
the processing section 40 is controlled by a user input so 
as to produce tba images required to generate a pbasa 
rs^u- oi the sample. This can be done simply by 
35 appropriate input into the processing section 40 and the 
processing taction 40 under tba influence of appropriate 
soffcoars loaded into the processing section 40 can then 
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cause the control section 44 to output appropriates 

n \« \w ?? - v u - 
will first oauee the object leas 22 produce an in 
focus image of toe sample and timn two dsfeerassd iaa&gss of 
Oho samgao, one on each aide of the fueas phoa- r whss 
the Im i«« a? is loea ^ < \ N < x 

than produce ono in focus and two defoeesed images, ton 
^©focuaad images could foe produced which will provide 
.sufficient internet ion to anahla the phage image to be 
g®m«r&ted for the processing seetioa 40. 

The data collected by the device 27 is than segrglied to 
the pzac&mim section 40 so that the data can foe 
processed in &cco^te»e«- wifck thm algorithm described in 
the above ~me^tioa«a Xi»fe*Jfxiatioa«X, application smd tfoe 
phase iM»m -««o«r»t«a- aM ai«$Uy«& tm, the monitor ^b 

•The m»ipt3l*ti«ai of tto m&§mafcic 3m&sw* will introduce 

nt^ tae ww^oe ^ a ess^ed 

onto $ he a;.\reee 2>b la .car?;, icular , th* &aj«mtammt of the 
ofolescive lens 22 to fore cefecased images will esses 
aberrations to &* g#st®rat^d io those ioegue which neat he 
taker accoaut of in order to produce a true pbase imago of 
tha ssesple. 

In erder to co^poneate -educed by a 

change - owes rl the *vos ,2 a 

transformation, is generated which is? applied to the data 
receiees by the device 27 to transform that date so ae to 
remove the aberrations introduced by the magnetic Lena 21, 

In order to generate the transformation a teosm roforenco 
grid such ae that shoea in Fig-are 2 ia located on the 
support 20 in piece oi lias sample S. Ito image of the 
reference grid 2 is than detected hy tha tiaoosseeet 
screen 2S with a parsienler voltage applied to the lane 22 
to goesrata, £os erampUo a defocused image > Tha image 
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detected fey the is that shown in Figur® 3 aM it 

eaa be seen th&t tfcs iwgs has h«ea sonowh&t. by 

the aberrations introduced by Che changa in the suspect it 
1mm 22, 

Since the processor 40 can be provided edth data relating 
to thm txum so^Mguration mnd shape of tbe reference grid 
ahosm in Figure 2, a eomp.erl.sjon between the detected 
reference grid ass shown in Figure 3 and the true grid as 

a in riguxe 2 can be made and a trans f oxcart ice 
9*»»rat«d which will transfor the data of Figura 3 into 
the position show in Figure 2 to xm&m th» «fc*rr«fci®»*. 
Tbe traeeformetion which is retired fc<& trwslom thm 
image of Figaro 3 back to th# tr?a# z*£*r*toc® iasge of 
Figure r la >v.us x^iat .c-a to a 

sample.-, another transformation is generated for a 
different -voltage applied to the lene 22 to produce either 
a sd image or, tor that castas an in 

focus image of th» sr»f«» .ampl*. 

U lu i«$ detected eg the oe\ Ua * v c 

la shown* in Figure 4, the sans - I have 
aberrations introduced iafe© it fc* 

power of the lens 22 in order to produce the defoousad 
i»ges or, for htet matter, tbe in focua image as 
described above, The trMf»»ti» ^sfeich prayionsly 
bean geaeratad is therefore applied to tbe data relating 
to the issage of Flours 4 so an to transform that image in 
accordance with thm transrossmtloa to thereby produce a 
true image without tbe aberrations,, 

Soch an icatga im shown in Figure S which baa tba 
aberrations reaocsd to thereby prouids a true image of tba 
sample* 

Similarly., tbe other images which ara created are also 
roe - I t.h« parties 1 a s 



transformation relating to that image (ia* which rolatea 
to th« v;>lUg« /vlirf to th® lens 22 to ,o \ the 



5 Th& data relating to the Imago is therefore free oi 

aberrations aad ear ha processed, to provid* s tree phase 
iesage of the actawOL eaapie tree of aberrations created bp 
sever of the objective Isas 12, 



.0 \ Leares * > S ahe , ^ nvi i» 

I i tea x \ \ ^ N > >e.tas * 
ahea toe defected Images obt&i&od.. 

Fspaaa s,s aa oeervieo of the spates*. ^cv , to hhs 

S wfoo&lm»nt > mto<m**& 1«» Wl m& W2 and i» focaa 

i»f« 103 are obtalaea ifc. ths> taftftoor jftwtcrib«a ah v. rhs 
spat as no >m at 

stop l N 5 ^ moment of 

the three isssgcs with a view to placiag thss information in 
3D * the o - > oo or ia ethos words , 

th i * oat ism i» th® i»^®su lawyer,, la 
e - « ad t >ras of ihUs aspect ot the invs 

i»' parfoamed as a mortal alignment step aa shown by 
stop 107, After course ali^smasxt has baea perforated 

ia aeeordsnce with steps 105 or 10? (or both of thos* 
stops In co^inution) , a fine aligmwmt step IDS ia 
performed to prowls!® flue aligassant of the images so that 
the iaacses can *h«» ba to form the phase kxssg» of the 

sample io tho s«s»wr previously deseri&#uV 

Figaro 7 ia & flow .phaqrt. "whtck shows the detail of the 
wacaal alignment atop 10? of Figure €. 

a.* revioasXx Sescxhhoa he coarse f making the 

daiocsssd images, tho chaago ia the potentials applied to 
the lane 22 will distort tho dofocaaed images, thereby 
resultine. ia the information on tho images aot bsiag tha 
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-\ same position a® the in focus issags, which * It 

isspoTOifelfc or greatly reduces the quality of the phase 
image which mill toe ototulaeo; from fctoose shi e Image; ^ Th® 
Blight dUtmt ion of the three images is re resented in 
5 figure 9. The iwm®& and 103 *t ^ x ^ ^ * ^ , 

i sections t«Usn^ to the image 103), 

At *tmB. U0 the images 101* 103 and 10S are laid oas alaeve 
the other te form as* imag* .afca«k. Tfens, this places the 
10 images in overlapping o ^ one above the d ^ 

aa in Figure 10 . As is sfeown in Figure IS, the 

oat aimed in the is&a#«« do«s& no- sods % 
» bsKmus® of the distortion* r&f&rrod to atov-e. 

IS At step Hi the images? are rase sled if necessary simply to 
make tea iasgss more easy to handle. This is obviously- 
desirsdals if the original iaages 101, 102 and 103 are 
r e la t It® ly large » 

20 M step the in focus images ie selected and oae of the 

defocused images is selected. These images are in the 
onfigmrati ^d 

at step 11.3 the user manually manoeuvres the in foaua 
25 imago so that the information in the two images is placed 
Into alignment* This ia done toy click an edares 
on the user's PC, whicto translate, rotate and stretch one 
of the images to place the information in the images* into 
al *his will tm tit i - >1 ?! fc 

3 0 ota or runs s.t I > 
relative to the otto^r. 

As shcvo s.n r ; caw Ji, the three images 101, 103 and 103 
are shown in stacked or overlapped configuration, ehereia 
3d the images 103 and 103 have been rotated or moved so that 
the information in each of the images is ia soi ignaeut , as 
is shown in Figure 11. 
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At step 114 tb.® umz mak#s a decision that tha ?iiig>aoont 
of the tw isastg*® is cosrsst so t:hafc the informs toon in 
sac V a ps o:?coo Uies ret\ 

5 1 IS and tha ofeh»r &*£®vus&& imago is aligned in t&» sama 

«aiMM8£ Vi < 5. 

At stmp tW too original dafacaaad images 101 and 102 ars* 

tr*m»£or»«8<S using th« «llg»Mat p««a««s oalch ^re 

10 obtained at step tit. Th*»r tim 0»ft»etfc««d imps 

transferase; r< o; iv^ to tha In focus uao^ ^ soa> * h 

iftfotm&fcion in each at the three iax&gec into as ^x&ct s$ 
po&uibl* alignment the operator can obtain by vieoing tins 



20 i each he ^ ^ N v oho 




Figure « Mi fcfc* fin* *lt&wmnt which i« ased to align 

o station within tito thmt 
obtained after fch* coarse alignment has bean p*z£axim& in 
accordance with Fig«** S, This £tn® align*** stso is 
3 0 portoooool aatomatically by tap processor 40 in accordance 
with the algorithm described with reference to Figaro 8. 

with reference Co Fignr® 8, Mm la focus its*** 103 and one 
of the defoeosad isagts osoch as tap i^age i;n ? ara 
35 seiaotao: so as to narforas the flea aligaaaaat oo the 

detocoseb iaagc .101 rslativo to the ia focus iaage 103, 
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At step 111 tk® cropped im&gr® 101 »#* US is divided 

into a plurality of cells 202 (««« Figure 131 , That ia, a 
plurality of separate regions. each of vhieh will be 
procs^s^d individually in order to perform alignment of 
5 I sorm dsn in he it 
i» the ** focus image 103. 

At step 118 tfe» iMoMtios* £» th« dell 202 of tfe* 
defocuoed image is correlated with tfc* information in the 
10 e«U 203 of the i» torass image at each point of a 10x20 
pixel scan area* Xa oth#r words, the <S*£ovusad coll is 
placed cm»3f the in £&m® cell and the d»£o<m««d cell sisvskI 
relets to the in focus? cell in a a 0x20' pix»l r*«t«r 
rsi s\^\ , 14 1 „ 

15 

at step lid a. relative score for too degree of correlation 

The 

purpose of this step is to identify the position of the 
C cu8'?<i uoM x « lax i v;-; to the in focus cell which yields 

10 the boot correlation i>£ t&e information to that cell 
relative to the information in the in focus cell, and 
there N > c each >i 

the locations of the defocased oell in the 20x2 D pises 1 
ttero s an & relat \e s ore of the « 

25 hetuaon the information in the cell at that position 
oc:aow so she J.of orssat ion in the in tocos inage is 
obtained. For example, the score can he a eelae between 9 
and l . rhe correlations are stored in memory within the 
crocs;; sec 4:0 , TTd.s procedure oonti.a«ss tor each of the 

3 0 rolls of the def censed image until all of the cells base 
been correlated. part of the program then ceases at 

step 120. 

•The other da focused imtg* 102 is then selected and the 
35 procedure occnss, as dascr;,tea with reference to 

steps 117 to lis, so that stored jorrelel op ralaes are 
htaioe h of * he cell a at 
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image. The best coxx«lfttion for each cell position is 
therefore provided by the highest stored correlation value 
for each of the calls in the sfeossKt rakss, At step 121, 

10 ,\ t \ 1 .st \ ; x for ^ 00 s * , ;o; ^ 1 led \ the 
corrols^\,c «lus for its , , ^ , ^ , , y* * s>8 te 

averaging process, -The purpose of too averse inc pwcess 
is to remove possible irregularities wfc*** very little 
information is contained in a particnl&r cell and spurious 
interaction points in that call ss&y result in a 
correlation value which La contrary to the co: alat on 
sed In 00 glib at lag cells. * a if 

there is a largo assoant of information in a particular 
call, an<l a very high degree of correlation b* tiv^ 
information In the in icons sell, than the a- . . ;v- 
Ni o«* - x v v very Itfcie r^act on the x 
value obtained for fch&t cell, Epwn«r, if there is very- 
little information la a particular ceil ana a correlation 

hioh aouie tend to w&nt to shift 
that particular cell in a direction or sasmsr contrary to 
the manner In which sarroanding ceils axe to be shifted;, 
the averaging process ^rill tend to esssooth that shift and 
bring it more into 5 with the ger.aral tread of 

movement respired in neighbouring ceils in order to align 
the information in those eeiia with the information in the 
la toons i»g«, 

at step 12a the peak value in each correlation »p Is 
ohteined and the of feet of that peak correlation from the 
centre of the ceil is stored in a correlation table. This 
provides a general indication of the amount the defocusad 
call should he moved relative to the In focus cell in 
order to provide correlation between the iaformacion in 



At step 123, the deiocased image is warped in accordance 
with the v x x la a correlation table obtained at 
step 121 to effectively nova the cefocosad cells by a 
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a $ nna , tr&mx to pro-* da corrs 5.1 i ox; bstwaan thm 
information in ahoaa eel Is n\! tb th® aorraS|y>naiing 
lafornatlan in th« in focus a ts >l tb la i ova* aaga 
1153. For ®aofc pixttl in tha final damnation imaga a 
5 soats bution fros ps I iaal n h urea 

inmga i !? co«pat«d b&ssd upo» th« valuta fox th« w*ri lag 

rias a< ns 

tha v«rp sb really a cor*; xao ly ^rsabla stretch 
operation,. Tbl« tborafora parioxana a fins alipanant of 

10 tba information in aask ismga after fcn& alignment, 
ao as ta provida much batter correlation of th« 
information in tba dafoensed imag&a and tne in facas inaga 
-which oan than ba uaad fee $ro«£d« tna data for producing 
tha phass haaga in &o«ox4a»e® with the si 

IB F' v --"" ! ^ ao Poland in aforementioned coupons! ay 

t'ntarnat ana) — nation* 



'rhuau this aadxxlinant of tha invention, rather than using 
a fet ain a 

20 msamrs of the a?&oxsra: at: distortion iatrodaaab by ths 

aayaotia iana 22 whan the in foe as and ds£oa\s.sed images 
are obtained, uses the in foens imp ass thm perfect 
N x n n t - n ra^orenoo to 

oa effective fen preformation' sform 

25 aha dafooasad image to co^ensat® far tha distortions and. 
«J**«x*tilcs»8 latjroatocM 22 whan tb* <2*£ocys*<l 

a-! ara obtained. 



< * i a of t ha 

30 inwnri^ nay readily be efiactad by peraene sfcSUad 

odthias fche art... it is no ha u*& want ion 

ia not liaaited to tha parti* j as arsbod m - d< - - by 
way ot saaapie baroinabovo. 
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£^b!:aai 

i* ^Pl ss £c$ a-soo^cio ; s phase haago of u-s 

\ o%o meao^ ■• n ^ 

V Least O v 

>ro*« a a&gnofci tot 

focusing the electron boas sasanatiag from aha objaet; 

10 control awaus for controlling thm electric signal 

tppUod to cha magnetic Ions so - , - - 

< i focus o>; the ral&fciv* to a proscribed plasms so 

tfeat so in focus imag* wo&/ow. 4*tosi\m&& ismges '** t&« 
object ars produced at th® piano? and 

15 d*t*«ti»sr sms for detec t lag the imtgrnu to 



L ^ y- * e a of claim 1 wherein tha at least 

Inns i® an ofej«ctiw X«os, 

20 

3s TO® apparatus of capias ,\ vherei.0 ^ e 

ivr , , h\v or 

jdMo^s vhv: \ c-^t;,=!s;v apphleh to ^cia&raw a 
magnetic Hold which foeusas Coo slactroa beam, 

25 

4. The apparatus of claim 1 wneroia tho detector 

comprises a charge coupled osvice at the plaao for 
hv the electron beers and providing a data output 

indicative of the images detected by the charge coupled 
30 device. 



S, Tha apparatus of claim 4 whmin tho charge 

o > 1 la, ice is < reacted to >r< fox 
receiving the acta and for processing too data to form a 
35 phase image. 

f , The apparatus of claim S whereio the processing 



mesne processes data is accordance with an s Igor it ha which 
solrss the sransport of intsneity equation ha produce the 



of 5 tie rtro 

maans forma part of ths processing means aad aha 
px >cess § upon use? inpat ewes - * a 

«i«*»U®a to t&# ians to bo &&;i»»**<5 so aa to prodaee in 
focus mxd/oz defoeufsea ie.egea cf the objeet to provide the 
data fxxm whieh tto ph&mm imgr® can bo gmmxs&*&. 

8.. Tfe® apparatus of olai.es 5 wher»-xr 5 the prac^esor 

also condensates for aberrations intrsahsced by the 
•»*Sr36«ti« leas hp parioxaalag a tran&fos^lsion on thm date 
provMod hut the <S»t»et©r relating to saca of th» imps, 

3* Tha appasaaas of claiM 0 wherein the 

as s a to a 

known referesec aaisxple, produoiag o N ,na 
regained to convert the defeated data relating to the 

a e Ins d 

by tha fletecfor so as to coaeerf tha data to thereby 
for ab^rrabiossjs Introdnsxed by the :asgaetio 

lea >8h* apparatus of: claim S wherein tha 
traasioraatioa is obtained by comparing tha seioeosad 
i^sge with the in focus iswge, and the dofooaaasi image la 
transferred so as to align ^ata ia tba stetossmso^ i«ga 
^ <■ 0 ^ ^ in the x . ^ x^aae 



11. :he aapsrataas i le.ua 10 wboroin tha 

trans ternac las eaaptises a coarse transformation is which 
the a\K\\ ^ :;a? sod the xn ::oci; ;s ir;sge sre \* >. ^\\o 

sad era of the iaages is noved relative to the other image 
ho align data in the images, and thmx a fine aXiguaaut 
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«t«p in which tha dafocusod image is divided into cells? 
and ssdi c«ll is compared with a corresponding soil of the 
in focus image* so aa to more data in each cell to more 
MaeXy alism that: data with the data In :o£ reloading 

mil® of the i» focus temm* 

12 , ■ Thm apparatus of claim il wfewr*** fcjb* coarse 

sx i m*nt fu ha >p o ha i aces so as 

to vdde ass Imugm eon*i«fcinsf ©* fcfe* owk 
of the defocased and in focus images, and thereto oho fine 
Hip«»at includes dividing the cropped dot car sod 

iaaages into the plurality of cwttft. 

13 , the apparatus of claim X2 wher#i& the plurality 

of sails of tha deioeaseo image are mo-red ra Xsfcive to the 
la. fo; s ells La a ^a**les 

for each rnvwrnsadt 1& tfc« pattern are ohtained to enaliXe 

ioeaa call relative to tm &a£ocused call which provides 
the hast co? - i 

14 * tte apparatus oXala a t he capiat loo 

value for each cell is averaged with neighbouring cells so 
ae to produce au average scare let ion factor. 



15. atas^ os c lam 14 a-aerain ate calls are 

warp ad ia. aaoordaaoe wifcli thm ««rr elation factors in order 
to acre iutomatioa within the ceils so as to provide film 
sorre lotion of that ;. atersat ion with the eorreaposi&ing 
information ia the la focus iaaga.. 

XS. A transmission electron microscope ins 

n - v tha tt x \oo 

microscope farther ins I ud»s; 

as anode for attracting electrons iron the 
elect roa aoxraoe ; 

at leaat one ec^easer lens for receiving an 
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electron bea^ ; ^ ;;.he anod* «ad iocvnxng thm ^ \ o 
beam Imo a relatively thin beam for application to the 
object i 

the obj^ctiva lens for receiving elections 
transmitted through the object and for focussing the 

O * hi::-i,::. l^tO iOSigO ? 

an intmmsm&im® tmm and a projector for 
imaging the electron beam onto the eatector* 



17. A of prMuslsg a phase image of an object 

from an electron beam, iaftladlaflf..*. 

causing an elaotrom beam to isgpian® xm an til&mst- 
ansl detecting the tiU&txim h**m emanating Srom thm objeen; 

focusing tea electros beam emanating tress tha 
object with a magnetic focus Xana by adj-ufftisttsf a» alactrio 
tUu d supplied to the lens no as to produce an in focus 
a ad.- or dafeca ad act.; 

processing data relating to the in foaan &ad/or 
x v % sjo as t v , \ ^iv-s ^ 

La ?s of tha object. 



ia» Tha method of claims 17 wherein the at least one 

magnetic lane is an objective lens, 

19, Tha method of claim 18 -wh&x&l® the magnetic fane 

is foread ;:ro?n ratal coils, grids or platas to Khieh a 
voltage is applied to generate a magnetic field ^kich 
focuses the electron bea. 



as, Tte mat too >»£ s. d v.: * 

onto a detector ^hteh comprises a charge coupled 
for detecting the electron benm end providing a data 
oet,gat indicative of tha image* detected by tha charge 
«. I N daa oe, 

processes date i» accordance with the algorithm 



dieclossed In the above- Ldem:.i£ lad r^u^matior.al r^esv: 
application to produce oho phase image. 



as. The method of claim 1? wharsio the focusing is 

S parfomed andar the val ^ e of « processing ^eaaa ami 
the procuwlag upon input, c&us«» m« voitaga 

supplied to the Isms? to be adjusted so as to produce io 

aed/or defection, images ©« the object to provide the 
data from w&xcb the phase image can fee gwntM, 

10 

23. l*he wtW of claim 1? therein the processing 
atop alao c«penaates for aberrations X&trodncad fey -th» 
a«*sa«fci«? l®n*» by perfc^mi&g a transformation on the <*afc* 
psovUed by tha detector relatlngr to #ach of the images* 

IS 

24, Th® method of claim 23 whwrtfife th« t^Aasf oxmet io» 
ia obfce^aeJ Oy ^ n s data salvias to a kaoma 

x > a * v x n X ^ to 

convert tha 6*fc*e««d data relating to the kiunm rsfenssce 

spp.ly lac that ts&M format ion to the 4ata produced by the 
detector «o aa to concert the data to thereby compensate 
for aberrations introduced by %tm magnetic leae. 



25 2B* &m method of claim 23 mhareia the transformation 

s ol k! by comparing th* deiocasad imago with the is 
faces image, and the def caused image is transformed so as 
to align data in the defocseed image mith corresponding 
data in the in focus imago. 

3 0 

20 » The method. ®£ claim 25 *kmx«in the transformation 

comprxaes a o nx. ^ - ut, us wh\^ t hv vto 

Imago and the in focus image ar® overlapped and one of the 
images is moved relative to the othar Image to aligs data 
35 la a, ,ad :Ss« a fine aliment atop in which the 

daiocueod hnaga is divided into cello and each coll is 
compared vUb a corresponding cell of the ia facne Image, 
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in each cell to more >;i^-.y align that: 
in cor* c I ths si 



Of t&« d«focus»d and in focus imagec., and wherein the sin® 
aligneest ®%®P inoimm dividing $hm cro^xl defocnsed 
imagss into the plurality ot o»H». 

2i 5 Tbe »«fcfco<i of claim 27 ^aerain the plurality of 

sella of the &®S<ocum& isaage *** aasovea »lst.i¥a to the in 

cells in a raster pafet*JR», .Sttd <eo*r*:i&« s >o values? 
for each oa - to eaahle 

the tost- correlation, and therefore the location oi the in 
foetus coll rolative to fclw detoemsed coll Aich provide 
th.& bsssfc correlation to bo obtainsd* 

3.9 v The method of cia Im 28 therein the eoruaadas 

value for each cell is aanragsd with neighbouring colls? ao 
as to produce as average correlation £*efc©ar» 

ells; u e 

► with fc&a correlation factors in order 
■ within the calls 00 as to prouide fine 
orreiats n ~t that Information with the tors 
iuioruatico in the in foots 



3i« ? n;H>aruca s an 

objoor using in goes?* ^ a 
beac c£ siectrcec ccich traocuit through or arc reflected 
£XG® an objeot, and in wMoa the noass of electron ia 
controlled to produce in focus and aelooosabl mages of the 
o&jec mid a parat ox including 
proc-^su rn* for^ 

( a ) rao - - - a ? 3 \ s ? or S; i : ar f rem the ds t ocas sed 
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rt \ ^ v i >>to , n 

*agaa ara obtained by 



(Is) proc®»»ia« t&© in : 
to ; 



app&r«t«« «& cl^i« Si wheroisj px asaiag 
moans is tor r«*BOvixi$ dUn>a.rtiaaa by a trana: rm&i »r= 
n«- I b\ coag sxing the &»focu««d imw* with tha in 
^ maoo, and the d^t ox^s d .naga t% s ass 

to a Hon data sod ixmg* witit <$®rr®*p®nM.m 

data in th« in focus itrnm- 



34, rha apparafs. jtsareia aha 

1 5?aji#f oxmat ion conpriaca a ecsarsa trans format ion in which, 
fc&e ia£ocus®cl image and the in inooa nvo^e arc overlapped 
cad s. % s wo b the ^vj^ 

to align data in t a sao. s - £ as alignment 

sstep in wMcn tha dafooasod imago is divided into sails 
and oach coll is o«paraa with a ®QrxmmnMm ©all of tha 
in goous imago* so aa to no\>-o data is aach call to Mora 
finely align that data with the data in coOTsponto® 
col la of the in focus im&gsu 



35. T&a apparatus of claim 32 whareio the coarae 
alx^n.»\ant father incladea cropping tha ioages so as to 

rov ^ Isugy o>:,.5 v . of 

tdv om 00 cl and in focus images mod wherei tha fiaa 
alignnoat atap inclodaa dividing tha cr^ppad dsfoaaaed 
imagee into tha plurality of call a , 

36, f ?lso apparatus of claim 33 wherein tha plurality 
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of calls of tha d®focu#«sa iseaga are saososd relation to aho 

for each awv*«wmt in the pattern ar» obtained to easbla 
tha best correlation, and therefore location of tho in 

toous co 1 » at wo to the So So sb 
too boot eorralatloa to bo obtained. 



37, l ! he apparatus of claim 36 therein the correlation 

•caloe for each call is averaged with neighbouring cells so 
ao to prodooo an wa«« correlation factor., 

38* The apparatus of claim $7 wherein tho cells ere 

- Is acc rdancs witl tha- eorreiation factors is order 
to thin tho colls 00 as to pro- s I a 

correlation of that infor^tion win& toe c».r*®s^i*3i»# 
information in tho in focas 

3 9 » $ i on 

is shtalnad 
by obtaining data relating to a known reference eaople, 

deteoted data relating to the known reference eassple to 
rotes as cs sa 

tras s st ton to ch« data produced by fch» datector «o ass 
to concert tho data to thereby oompeaeate for aberration 
introduced by the magnetic Imm. 



40. A ses so of producing a phase ixaaga of aa object 

using .in focus and de focused Images produced by a beam of 

os nxo t s " eta ro s 
os. ^ ^ Us vhioh tha heass of electron is oontroKsad to 

produt - as d iss age >i tha at aid 

apparatus including the afcepa ofs 

{a} rssaoeing distortions frose too daiooaesd 
1 sa §'oss iatsa oed into th n < s * 
vthmx t&e defocnaed imagea are obtaisaed by 
the control of tbs magnetic leossj end 



WG03/0J2822 



.Cb) 

object v 

S 41. *&m aashhod of claim 40 whmin tho ph&.m image is 

predaead froa* 
of tha ofej#cte> 




ban u;< thn ste| 

10 of tmmVlm distortions ocagociaaa per go? Log 

images t t * c wform s h» 
£»*«** te £«r distortions i»!.rof$uo„d by 



15 «* The «cmo**iag to claim 12 wherein th« 

transformation is obtain^ by imaging & fcacnm reference 
s«a$ltt, protein® tfaa tswComt&ea retired to coawrt 
tha itnag* of tto» te«m r«£«**»c« s^k to conform witn 
tha town configuration of tbo known xoforsmoa aasapl**, 

20 

44* ma mathod of cXsim 43 w&oraim tba transformation 

is obtained by comparing too <8afonosad image with, the In 
image* and t&fe «»focus«<S ioage is tranaf orned as 
oo aliga data In tha o!#focuas4 image with corresponding 
data in the in foous imago. 

45, 1*ha mataod; of claim 44 wherein the transf ormafeion 

coeagrisea a coarse transformation in which the dofocosed 
ixasge and the in tocos image are ooerlappad and ana of tha 
iaagas l.s mooed relative to the other image to align data 
in the .i.^Hono sod r on a fine aUgament step i.a which the 
defoonaad image is divided iota ceils sad each ceil ia 
compara-d with « e> rreagonding cell of the In toons Image, 
so aa to mooa data in each cell to mora finely align that 
data with tha data in cor r m spending eaiXa of the ia focne 
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Tls<s> awthoA of claim iS wherein th® soars© 

to provide an 3a ont ating of. \ha overlapping rations 
of o tod te focus v s f iniS 

* N ^ ^ - - - nol oa;oc^co; 

isvsgess into the plurality of colls; . 



method at dais IS vrho - « th \ 0 f 

e®xx» of the defooussed Image «s isovosl «ktiw to the in 
toon® calls in a raster pattern, aa3 «ofcr*lat:i«» tti^s 
tor oaca mo\ >mont in the j»afct«r» «X* O&fc&ined ps «m«bl« 
the best correlation, and therefore the location of the In 
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